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ABSTRACT 

We present a connection between two seemingly disparate 
fields: VC-theory and graph theory. This connection yields 
natural correspondences between fundamental concepts in 
VC-theory, such as shattering and VC-dimension, and well- 
studied concepts of graph theory related to connectivity, 
combinatorial optimization, forbidden subgraphs, and oth- 
ers. 

In one direction, we use this connection to derive results 
in graph theory. Our main tool is a generalization of the 
Sauer-Shelah Lemma [301 1101 [12] . Using this tool we obtain 
a series of inequalities and equalities related to properties of 
orientations of a graph. Some of these results appear to be 
new, for others we give new and simple proofs. 

In the other direction, we present new illustrative examples 
of shattering-extremal systems - a class of set-systems in VC- 
theory whose understanding is considered by some authors 
to be incomplete [1UI 1211 152] . These examples are derived 
from properties of orientations related to distances and flows 
in networks. 

1. INTRODUCTION 

Orientations of graphs have been widely researched, going 
back to the celebrated strong-orientation theorem of Rob- 
bins (1939) [31], and its generalization by Nash- Williams 
(1960) [2H]. Several results analogous to Robbins' theorem 
have been obtained for other properties of digraphs [181 1151 
I20II17|[TT] . In another direction of research concerning orien- 
tations, Frank [T§] has shown that every fc-strong orientation 
of a graph can be obtained from any other fc-strong orien- 
tation of the same graph, through a sequence of reversals 
of directed paths and circuits, such that the fc-strong con- 
nectivity is maintained throughout the sequence. There are 
many open problems in this area, both of structural and of 
algorithmic nature. For a comprehensive account of known 
results and current research questions, especially relating to 
connectivity, see [7] . A different line of work concerns count- 



ing orientations with forbidden subgraphs. These problems 
have close ties with the theory of random graphs. An exam- 
ple of work of this type is the paper of Alon and Yuster [3], 
concerned with the number of orientations that do not con- 
tain a copy of a fixed tournament. 

In this paper we prove statements concerning properties of 
orientations and subgraphs of a given graph by introducing 
a connection between VC-theory and graph theory. The 
following are a few examples of the statements that we prove: 



Let G be a graph 
the number 
of connected 
subgraphs 
of G 



Then: 

the number 

of strong 
orientations 
of G 



the number 
of 2-edge- 
connected 
subgraphs of G. 



Let G be a graph, let H be a digraph, and let H be 
the graph that underlies H. Then: 

the number of the number of 

orientations of G subgraphs of G 

that do not contain a — that do not contain a 
copy of H copy of H. 



3. Let G be a graph and let s,t € V(G). Then: 



the number of 
orientations in which 
there are at least k 
edge-disjoint paths 
from s to t 



the number of 
subgraphs in which 
there are at least k 
edge-disjoint paths 
from s to t. 



(A similar statement holds for vertex-disjoint paths.) 

Let O' and O" be two orientations of a flow network 
N such that there exist s - t flows of size / in both O' 
and O" , and let d be the Hamming distance between 
O' and O" . Then there exists a sequence of d edge 
flips that transforms O' to O" , such that all the inter- 
mediate orientations preserve the property of having a 
flow of size /. 



The technique used for proving such statements relies on 
the well-known concept of shattering and on the less known, 
dual concept of strong-shattering. Shattering is commonly 
defined as a relation between V('P(X)) and V(X), where 
V(X) denotes the power set of X. Continuing the work of 
Litman and Moran [261 128] , we present shattering as a rela- 
tion between V({0, 1} X ) and V(X). This facilitates new def- 
initions of shattering and strong-shattering that differ from 



each other only in the order of the quantifiers (see ij2]). The 
transposition of quantifiers demonstrates a certain duality 
between the two concepts of shattering. This duality en- 
ables an easy derivation of new, "dual" results from known 
results. 

Our main tool is a generalization of the Sauer-Shelah Lemma 
which we term the Sandwich Theorem (Theorem [5| [301 1101 
1121 1211 [5] . This theorem states that the size of a system S 
is at most the number of sets shattered by S and at least 
the number of sets strongly shattered by S. Interpreting 
this theorem in the context of graph orientations yields in- 
equalities that link orientations and subgraphs of the same 
graph. 

Systems for which the Sandwich Theorem collapses into an 
equality are called shattering-extremal (SE). These sys- 
tems were discovered independently several times by dif- 
ferent groups of researchers [241 1101 1121 [6j. As far as we 
know, Lawrence [24] was the first to introduce them in his 
study of convex sets. Interestingly, the definition he gave 
does not require the concept of shattering. Independently, 
Bollobas and Radcliffe [10] discovered these systems, using 
the shatters relation (a.k.a. traces). Furthermore, they also 
introduced the relation of strongly- shatters (a.k.a. strongly- 
traces), and characterized shattering-extremal systems us- 
ing the shatters and strongly-shatters relations. Dress et 
al. [121 [6j discovered, independently of Bollobas et al., the 
same characterization, and established the equivalence to 
the definition given by Lawrence. Several characterizations 
of these systems were given [24l [TOl l6l |2T1 l5l l32l [28] . 

We present two general classes of SE systems that stem from 
properties of graph orientations. One class is related to prop- 
erties of distance in a weighted network, the other class is 
related to properties of flow networks. This allows us, in one 
direction, to apply known results about SE systems to prove 
results concerning these two classes (such as (iv) above). In 
the other direction, the two classes form non-trivial clus- 
ters of new examples of SE systems, and thus they may be 
useful for a better understanding of SE systems. We note 
that the known characterizations of these systems are con- 
sidered unsatisfactory by several authors [101 1211 132] . e.g.: 
"... a structural description of extremal systems is still sorely 
lacking" [ID]. 

Some of the results presented in this paper can be proven in 
alternative ways. For example, McDiarmid [27] implies some 
of our results (including (i) above) using general theorems 
from clutter percolation. 

Notational issue. The systems we call shattering-extremal 
have been independently discovered several times in various 
contexts [241 [ID] . Accordingly, such systems have been re- 
ferred to as lopsided, Sauer-extremal, Pajor-extremal, among 
other names. We call these systems shattering-extremal 
(SE), following the work of Litman and Moran [261 128] . 



2. PRELIMINARIES 

In this section we introduce the concepts necessary to formu- 
late and prove our results. The notation related to systems 
and shattering closely follows Litman and Moran [261 [28] . 

2.1 Systems 

In this paper, a system is a pair (S, {0, 1} X ), where X is 
a set and S C {0, 1} X . Given a system § = (S, {0, 1} X ), 
we define the operators S(E>) = S, C(S) = {0, 1} A , and 
dim(S) = X. For simplicity, we use |S| for |S(S)|. A sys- 
tem § is trivial if S(S) G {0, C(S)}. The complement of § 
is -.§ = (C(S) - S(S), C(§)>. Note that there are exactly 

2 2 ' X ' systems § for which C(S) = {0, 1} X . 

2.2 Shattering and strong shattering 

Given two arbitrary functions / and g, and A C dom(/) n 
dom(g), we say that / agrees with g on A, if f(x) = g(x) 
for all x £ A. We say that / agrees with g, if they agree on 
the entire dom(/) n dom(i?). 

We define shattering and strong shattering with the help of 
the merging operator (*). Given two disjoint sets X and 
Y, two functions / G {0, 1} X and g G {0, 1} Y , let / * g 
denote the unique function in {0, 1} XUY that agrees with 
both / and g. Note that * is a commutative and associative 
operator. 

Definition 1. Let S be a system, let X = dim(S) and let 
Y C X. We say that: 

§ shatters Y , if: 

(V/ G {0, l} y ) (3.g G {0, 1} X - Y ) :g*fe 5(S). 

§ strongly shatters Y, if: 

(3 3 G {0, 1} X - Y ) (V/ G {0, 1} V ) : q * f G 5(S). 

Observe that the definitions of shatters and strongly shatters 
differ only in the order of the quantifiers. A straightforward 
application of predicate calculus gives the following result: 

Lemma 2. Let § be a system and let {X' ,X"} be a parti- 
tioning o/dim(§). Then, exactly one of the following state- 
ments is true: 

(i) § shatters X' 

(ii) S strongly shatters X" . □ 
Two important subsets of 7 3 (dim(§)) are associated with S: 

Definition 3. The shattered and strongly shattered sets 
of a system § are respectively: 

str(S) = {Y C dim(S) : Y is shattered by §}, 



sstr(S) = f {Y C dim(S) : Y is strongly shattered by §}. 



Clearly, both str(S) and sstr(S) are closed under the subset 
relation, and sstr(S) C str(S). 

Given a set X and a family T C V(X), we define the co- 
complement (*) operator as T* = {Y C X : Y c ^ F}. 
Observe that * is an involution^ and for any two families A 
and B, we have i C B •» S* C A*. With this operator, 
Lemma [2] can be expressed in the following way: 

Lemma 4. Let § be a system. Then 

str(-.S) = sstr(S)*, 
sstr(-.S) = str(S)*. 

The following theorem is the result of accumulated work by 
different authors, and parts of it were rediscovered indepen- 
dently several times (Pajor [30], Bollobas and Radcliffe [10] , 
Dress [12] , Holzman and Aharoni [5l I21j). 

Theorem 5 (Sandwich Theorem [30l [TOl fT2l l5l I2T] ). 

For a system §: 

|sstr(S)| < |S| < |str(S)|. 

In the proof of Theorem[5] given a system § and x e dim(S), 
we consider the following two "sub-systems" of S, referred to 
as the restrictions of § associated with x: 

({/U m (S)- W : / € S, /(*) = 0}, {0, , 

({/Idtaw-w : / e s > /(*) - i}. i} dim(s) - { * } ) . 

Proof of Theorem [5] First, prove §| < |str(S)|. 
Proceed by induction on dim(S). The case dim(S) = is 
trivial. Otherwise, pick x e dim(S) and let §',§" be the 
two restrictions of S associated with x. By the induction 
hypothesis, we have |S'| < |str(S')| and |S"| < |str(S")|. It 
is easy to verify that: 

{Y e str(S) : x £ Y} D {Y : Ye str(§') U str(§")}, 
{FGstr(S) : x £ Y} D {Y U {x} : Y 6 str(S') n str(S")}. 

Thus, 

|str(S)| = \{Y E str(S) : x £ Y}\ + \{Y £ str(S) : x £ Y}\ 

>\{Y : Ye str(S') Ustr(§")}| 

+ \{Yu{x} : Y e str(S') nstr(S")}| 

(by the above inclusions) 

= |str(S') U str(S")| + |str(§') n str(S")| 

= str(S') + |str(§") 

> |S'| + |S"| (by the induction hypothesis) 

— IS]- 

Next, prove \S\ > sstr(S) | . 

We use a certain duality between shattering and strong shat- 
tering. This duality manifests itself through a mechanical 



tranformation on text written in "mathematical English". It 
swaps the pair "str" and "sstr", the pair "C" and "D", and 
the pair "<" and ">". Note that the dual of "|S| < |str(S)|" 
is "|S| > sstr(S) |". It is easy to verify that the dual of the 
proof for |S| < str(S) is a valid proof for |S| > |sstr(S)|. □ 

It is important to note that the duality used in the proof is 
mysterious and fragile. It is not hard to find (true) claims 
whose dual claims are not true. For further discussion on 
dualities between shattering and strong shattering we refer 
the reader to Litman and Moran [261 128] . 

Definition 6. The VC-dimension (Vapnik and Chervonenkis 
|36| ) and the duaJ VC-dimension [281 126| of a system S are 
defined respectively as: 

vc(S) d = max{|F| : Y e str(S)fl 
dvc(S) d = max{|y| : Y G sstr(§)} 2 . 

Note that by the definition of the VC-dimension: 

str(S) C {Y C dim(S) : \Y\ < vc(S)}. 

Hence, an easy consequence of Theorem [5] is the following 
result: 

Theorem 7 (Sauer-Shelah Lemma [33] [3S]). For a 

system § with \ dim(S)| = n: 




2.3 Shattering-extremal systems 

In this subsection we look at systems of a particular kind, 
namely those for which Theorem[5]collapses into an equality. 
We call these systems shattering-extremal. 

Definition 8. § is shattering-extremal (in abbreviation: 
SE), if it satisfies 

sstr(S) = str(S). 
From Lemma |4] the following result is immediate: 

Lemma 9. Let S be a system. Then 

§ is SE ^§ is SE. □ 

Similarly to Theorem [5] the following result has also been 
rediscovered independently several times (Bollobas and Rad- 
cliffe HO], Dress et al [6]). 

Theorem 10 ([ME])- Let § be a system. The follow- 
ing statements are equivalent: 

(i) § is SE 
(ii) |sstr(S) | = |S| 
(ui) |S| = |str(S)|. □ 

2 As a special case, vc(S) = dvc(S) = — 1 when 5(S) = 0. 



3. SYSTEMS OF ORIENTATIONS 

We use standard terminology of graph theory (cf. Bollobas [9]) 
Given an undirected graph G with vertex set V(G) (or sim- 
ply V) and edge set E(G) (or simply E), let n = \V\ and 
m = \E\. In this work, a subgraph of G is a graph G' with 
V(G') = V(G) and £(G') C E(G). For X C £(G) we 
denote by Gx the subgraph of G with E(Gx) = X. We 
consider only simple graphs, however, the results can easily 
be extended to non-simple graphs. 

An orientation of a graph G is an assignment of a direction 
to each edge. To encode such an assignment as a function 
d : E — > {0, 1}, choose a canonical orientation E and inter- 
pret d relative to E in the obvious way: d orients an edge 
e G E in agreement with iJ if d(e) = 0, and opposing E if 
d(e) = 1. For an orientation d, let G d denote the digraph 
obtained by orienting the edges of G according to d and to 
some canonical orientation. For simplicity, we also refer to 
the digraph G d as an orientation of G. The set of all orien- 
tations of G is 0(G) = {0, 1} E . A system of orientations of 
G is a system §, where G(S) = 0(G). 

3.1 Cycles and forests 

As a warm-up, and to illustrate our techniques, we consider 
the system of all cyclic orientations of a graph G, denoted as 

S C y C (G) = ({d e 0(G) : G d has a directed cycle}, 0(G)^> 

and its complement, -^S cyc , namely the system of all acyclic 
orientations. We prove the following inequalities: 



Theorem 11. Let G be a graph. Then: 



(i) 



(ii) 



the number of 
orientations of G that 
contain a directed cycle 
the number of acyclic 
orientations of G 



the number of subgraphs 
of G that contain an 
undirected cycle, 

the number of subgraphs 
of G that are forests. 



of E contains this directed cycle. This means that X 6 
sstr(§ cyc ). 

(n) Assume that Gx is a forest. We need to show that every 
orientation d of X can be extended to an acyclic orientation 
of E. Since Gx is a forest, G x is a DAG whose edges form 
a pre-order P on V . Pick (by topological sorting) a linear 
order L of V that extends P and orient the edges of E — X 
according to L (from smaller to larger vertex). Clearly, the 
resulting orientation is acyclic. □ 



Applying the co-complement operator to both sides of the 
equations of Lemma [TBI gives : 



Lemma 14. Let G be a graph. Then: 

(i) {X C E : Gx is a forest} D str(-.§ C!/c ) . 
(ii) {X C E : Ge-x has a cycle} D sstr(S C!/c ). □ 



Lemma [13] and Lemma [14] together imply Lemma 1121 An 
application of the Sandwich Theorem (Theorem [5]) yields 
the inequalities of Theorem I 111 Moreover, from the charac- 
terizations of str(-i§ C!/c ) and sstr(S cyc ) it follows that: 



Proposition 15. Let S cyc denote the system of all cyclic 
orientations of G, then: 

(i) vc(S cyc ) = n — k, where k is the number of connected 

components of G. 
(ii) dvc(§ cyc ) — m — c, where c is the size of the smallest 
cycle in G. 



An application of Theorem [7] and a standard bound on bi- 
nomial sums yield: 



Note that the two inequalities are equivalent. However, 
proving them in parallel illustrates a certain duality (symme- 
try). To derive these inequalities, we characterize sstr(S cl)c ) 
and str(-i§ C!/c ). 

Lemma 12. Let G be a graph. Then: 

(i) {X C E : Ge-x has a cycle} = sstr(§ CHC ). 

(ii) {X C E : Gx is a forest} = str(-iS CHC ). 

Note that by Lemma [2] the two statements are equivalent. 
To establish Lemma [T2l we prove: 

Lemma 13. Let G be a graph. Then: 

(i) {X C E : Ge-x has a cycle} C sstr(S CHC ). 

(ii) {X C E : Gx is a forest} C stv(^S cyc ). 

Proof, (i) If there exists a cycle G C E — X, then there 
exists an orientation d of E — X, such that G becomes a 
directed cycle. Clearly, every extension of d to an orientation 



Proposition 16. The number of acyclic orientations of 
G is at most ^^^r^ where k is the number of connected 
components ofG. 

In general, the inequalities of Theorem [11] are strict. In fact, 
as implied by Theorem[3n]presented in §0] these inequalities 
are strict if and only if G contains a cycle. Note that the 
second statement of Theorem [TT] appears to be known (it is 
implied by an identity of Bernardi [8]). Note as well that 
the number of acyclic orientations and the number of sub- 
graphs that are forests are two particular values of the Tutte- 
polynomial [9]. Aharoni and Holzman [T] have brought to 
our attention that the result can also be proven by induc- 
tion, using the graph operations of deletion and contraction 
of edges. 

A natural question is whether str(S C j, c ) and sstr(-i§ C j /c ) can 
be similarly described. The characterization of these sets, 
however, seems to be less natural. Nevertheless, we can 
observe the following: 

Lemma 17. Let G be a graph. Then: 



(i) {X C E : E — X intersects a cycle ofG} D str(S cyc ). 

(ii) {X (Z E : X contains only bridges} C sstr(-i§ C!/c ) • 

Proof. By Lemma [4] and the monotonicity of the co- 
complement operator, the two statements are equivalent. 
Thus, it is sufficient to prove (ii): Let d be an acyclic orien- 
tation of E — X. If X contains only bridges, every extension 
of d to E remains acyclic (by definition, a bridge is not con- 
tained in any cycle). Therefore, X is strongly shattered by 

~~ 'Scj/c- n 

Similarly to the proof of Theorem 111! Lemma [TTl together 
with the Sandwich Theorem yield certain inequalities. One 
can also derive an upper bound for vc(S cyc ) and a lower 
bound for dvc(-i§ C j/c). 

3.2 Strong orientations 

Let fc 6 N. A graph G is k- edge-connected if it remains 
connected whenever fewer than k edges are removed. A 
digraph G is k-arc-strong if for every u, v € V(G) there 
exist k edge-disjoint paths from w to h. Since in this section 
we only refer to edge-connectivity, we use the shorter terms 
k-connected, k-strong, and disjoint. 

Theorem 18. For an arbitrary graph G: 

the number of the number of the number of 

Ik-connected < k-strong < k-connected 

subgraphs of G orientations of G subgraphs ofG. 

Before proving this theorem, we state two well-known re- 
sults. The first is a characterization of graphs that admit 
a fc-strong orientation. The second is an immediate conse- 
quence of Menger's theorem for directed graphs. 

Theorem 19 (Nash-Williams [25]). AgraphGhasa 
k-strong orientation iff G is 2k-connected. □ 

Theorem 20 (Menger [5]). A digraph G is k-strong 
iff every non-trivial cut of G contains at least k forward 
edges. □ 

Proof of Theorem [HI For i e N, let denote the 
system of i-strong orientations of G and let Ti denote the 
family of sets X C E, such that Gx is i-connected. 

\T 2k \ < |Sfc|: By the Sandwich Theorem, |sstr(S fc )| < |S*|. 
Thus, it is sufficient to show that 

{X C E : G E -x is 2fc-connected} C sstr(S fc ). 

Indeed, if Ge-x is 2fc-connected, then by Theorem 1 191 there 
exists an orientation d of E — X, such that G d is fc-strong. 
Clearly, all extensions of d to an orientation of E maintain 
the fc-strong property, and thus X £ sstr(Sfc). 

|S fc | < |-F fc |: By the Sandwich Theorem, |S fc | < |str(S fc )|. 
Thus, it is sufficient to show that 

str(Sfc) C {X C E : Ge-x is fc-connected}. 



Let X £ str(Sfc). It is enough to show that every non-trivial 
cut of G contains at least k edges in E — X. Let (V',V") 
be a non-trivial cut of G. Pick an orientation d of X that 
directs every edge included in the cut as a backward edge. 
Since X £ str(Sfc), there exists a fc-strong orientation / of 
E which extends d. By Theorem [20l the cut (V' , V") must 
contain at least k forward edges in & and by the choice of 
d, all of these edges are from E — X. □ 



Remark: After discovering the above result, it was brought 
to our attention that Mcdiarmid [57] has proved a similar 
result using non-trivial tools from clutter percolation. 

In general, the inequalities of Theorem [TH] are strict. In fact, 
as implied by Theorem [40] presented in §[4] both of these 
inequalities are strict if and only if G is 2fc-connected. 

Let Cfc(G) denote the size of the minimum k-connected sub- 
graph of G. Computing c k is a known NP-hard problem [19] , 
even for k — 2. From the proof of Theorem [18] and from 
Theorem [7J we obtain: 



Proposition 21. If §k. is the system of all k-connected 
orientations of G, then: 

m - c 2 k < dvc(Sfe) < vc(Sfe) < m - c k . 



Proposition 22. The number of k-connected orientations 

m-c k J 

Observe that a simple corollary of Theorem 1181 together 
with classical results on the connectivity of random graphs 
in the G(n,p) model [37] is that almost every tournament 
on n vertices is fc-strong, for any fixed positive fc. 

3.3 General inequality 

We can abstract away parts of the earlier proofs, to obtain 
the following result: 



Theorem 23 (General inequality). Let P be a mono- 
tone increasing property of digraphs, and P' be a property of 
graphs, such that if a graph G satisfies P' , then there exists 
an orientation ofG that satisfies P. Then, for an arbitrary 
graph G: 

the number of the number of 

subgraphs of G that < orientations of G 
satisfy P' that satisfy P. 

Proof. Let §p be the system of orientations of G that 
satisfy P. Let X C E, such that P'(G E -x) holds. From 
the conditions it follows that there exists an orientation d 
of Ge-x, such that P{G E -x) holds. Since P is monotone 
increasing, P holds for any extension of d to E. It follows 
that X G sstr(Sp). Hence, {X C E : P'(G E -x)} C 
sstr(Sp), and Theorem [5] yields the result. □ 



3.4 Further inequalities 

The conditions of Theorem [23] are fulfilled by many natu- 
ral connectivity-properties of digraphs. These include s - t 
connectivity, rootedness, unilateral connectivity, or the ex- 
istence of a Hamiltonian cycle. 

As a further application, consider the following problem: 
Given a graph G and a digraph H, denote by D(G, H) the 
number of orientations of G not containing a copy of H . 
Erdos frj] posed the question of estimating D(G,H), and 
researchers have studied many variants of this problem [141 
[4] [23] . Let H denote the undirected graph that underlies H 
and let D'(G, H) denote the number of subgraphs of G not 
containing a copy of H. Then, similarly to the preceeding 
results, we obtain: 

Theorem 24. D(G,H) < D'(G,H). □ 

Using the same approach as previously, we obtain that the 
VC-dimension of the system of orientations not containing 
a copy of H, is at most ex(G,H), the size of the largest 
subgraph of G which does not contain a copy of H. When 
G = K n (the complete graph on n vertices) the quantity 
has been denoted as ex(n,H). When H is also a complete 
graph, this is the well-known Turan number [14| . 

A result of Erdos, Frankl, and Rodl [14] states that the num- 
ber of graphs on n vertices that do not contain a copy of H 
is 2 ex{n ' H){1+o{1)) , provided that the chromatic number of 
H, x( H ) > 3. This result, together with Theorem [24l yield: 

Proposition 25. Let H be a graph with x{H) > 3 and 
let H be an orientation of H . Then: 

D(K„,H) < 2 ^("- F/ )( 1 +°( 1 )). 

When H is a tournament, Proposition 1251 is implied by a 
result of Alon and Yuster [4], proven using sophisticated 
techniques. 

4. SHATTERING-EXTREMAL SYSTEMS OF 
ORIENTATIONS 

In this section we present SE systems of orientations, or 
equivalently, systems for which the Sandwich Theorem col- 
lapses into an equality. Two natural and general classes of 
SE systems correspond to orientations with a certain s - t 
flow, respectively s - t distance in a graph. Many other re- 
sults, including Theorem 1381 are direct consequences of the 
results for the flow or distance examples. The selection of 
examples is not exhaustive and there exist natural classes of 
SE systems of orientations that seem not to be reducible to 
either the flow or the distance example. 

4.1 Flow 

We consider flow in both directed and undirected graphs (in 
an undirected graph an edge can be used in both directions) . 
Let G be a graph, let c : E(G) — > K-° be a capacity function 
of the edges, s £ V(G) be the source and t £ V(G) be the 
sink. For a number w 6 R, let E w denote the system of all 



orientations of G for which there exists a How of size (at 
least) w from s to d. We show that: 

Theorem 26. S w is SE. 

As a corollary of the proof of Theorem fJH we obtain the 
following identity: 

Theorem 27. For an arbitrary graph G: 

the number of orientations the number of subgraphs 

of G for which there exists = of G for which there 
a flow of size w exists a flow of size w. 

The following well-known equivalence is useful in establish- 
ing Theorem 1261 

Theorem 28 (max-flow min-cut). The following two 
statements are equivalent: 

(i) There exists a flow of size w . 
(ii) Every s - t cut has capacity of at least w. □ 

Lemma 29. 

{X C E : There exists a flow of size w in Ge-x} C 
sstr(§„) 

Proof. Let X C E be such that there exists a flow of 
size w in Ge-x and let / be such a flow. Assume w.l.o.g. 
that / is acyclic. Pick an orientation d of E — X such that 
every edge with positive flow is oriented in the direction 
of the flow. In Gg_ A -, / is a flow of size w. The flow / 
remains feasible in every extension of d to E. This means 
that X e sstr(S TO ). □ 

Lemma 30. 

str(S m ) C {X C E : There exists a flow of size w in Ge-x} 

Proof. Let X £ str(§ 1 „). It is enough to show that every 
s - t cut has capacity of at least w in Ge-x- Let (S,T) be 
an s - t cut. Choose an orientation d of X that orients 
all edges of X which are contained in the cut as backward 
edges. Since X £ str(S tl ,), there exists an extension of d in 
which there is a flow of size w. Thus, by Theorem 1281 in the 
resulting digraph the capacity of (S,T) is at least w. The 
claim follows from the fact that all forward edges of the cut 
are from E — X. □ 

From Lemmas 1291 and 1301 it follows that str(S m ) C sstr(S„). 
Theorem 1261 follows from the fact that the reverse inclusion 
always holds. Theorem [27] follows by the Sandwich Theo- 
rem, combined with Lemmas 1291 and 1301 

Lemmas 1291 and 1301 give a characterization of vc(S„). For 
w G R, let e w denote the siz^3 of the smallest subgraph 

3 As a special case, e w = —1 when there exists no flow of size 
w in G. 



of G that admits an s - t flow of size w. Computing e m 
is a natural NP-hard optimization problem (it reduces to 
minimum Steiner tree, as shown in § 14. 3p . 



oriented from s to t. In every extension of / to E, the path 
p remains a valid s - t path of length at most d. This means 
that X £ sstr(Stj). □ 



Proposition 31. dvc(§ m ) = vc(S m ) — m — e w . 

From Lemma|5]it follows that , namely the system of ori- 
entations with a maximum flow less than w, is also SE. An 
application of Lemma[3]yields a characterization of str(-i§u,) 
(= sstr(-i§„j) ) and results analogous to Theorem 1271 and 
Proposition [3T] regarding S w . 

4.2 Distance 

We consider distance in both directed and undirected graphs 
(in an undirected graph an edge can be used in both direc- 
tions). Let G be a graph, let w : E(G) — > M-° be a length 
function of the edges, s 6 V(G) be the source and t G V(G) 
be the destination. For a number del, let Bd denote the 
system of all orientations of G in which the distance from s 
to t is at most d. We show that: 

Theorem 32. S d is SE. 

As a corollary of the proof of Theorem [26] we obtain the 
following identity: 

Theorem 33. For an arbitrary graph G: 

the number of orientations the number of subgraphs of 
of G in which the distance = G in which the distance 
from s to t is at most d from s to t is at most d. 

In order to highlight a certain symmetry between flow and 
distance (or more precisely, between minimum cut size and 
minimum path length), we establish the results of this sub- 
section in a manner analogous to the proofs of § 14.11 

We call 7T : V(G) — > K-° a potential function of the vertices, 
if for every edge (u, v) the condition n(v) — n(u) < w(u,v) 
holds. The potential difference of G with respect to n is 
n(t) — 7r(s). The following easily verifiable equivalence helps 
in establishing Theorem 1321 

Theorem 34. The following two statements are equiva- 
lent: 

(i) There exists a potential function with potential differ- 
ence d. 

(ii) Every s - t path has length at least d. □ 



Lemma 36. 

str(Sd) C {X C E : The distance from s to t in Ge-x is 
at most d} 

Proof. Let X G str(Sd). We show that every potential 
function for Ge-x gives rise to a potential difference of at 
least d. Let tt be a potential function for Ge-x- Choose an 
orientation f of X that orients all edges of X from larger to- 
wards smaller potential, according to tt. Clearly, tt remains a 
valid potential function for the entire G. Since X € str(Sd), 
there exists an extension of / in which there is an s - 1 path of 
length at most d. Thus, by the complement of Theorem 1341 
in the resulting digraph, the potential difference is at least d. 
The claim follows from the fact that all potential-increasing 
edges are from E — X. □ 

From Lemmas 1351 and 1361 it follows that str(Sd) C sstr(Sd). 
Theorem 1321 follows from the fact that the reverse inclusion 
always holds. Theorem [33] follows by the Sandwich Theo- 
rem, combined with Lemmas 1351 and 1361 

Let d G R, let pd denote the siz^fl of the smallest subgraph 
of G that contains ans-t path of length at most d. Observe 
that pd can be computed in polynomial time. 

Proposition 37. dvc(S d ) = vc(S d ) = m- p d . 

From Lemma[9]it follows that namely the system of ori- 
entations with s - t distance more than d, is also SE. Again, 
we obtain results analogous to Theorem [33] and Proposition 
[37] regarding ^§d- 

4.3 Further examples 

Many "natural" systems of orientations can be viewed as 
special cases of the above systems. 

As a first example, let G be a graph, let s G V(G) and W C 
V(G). Let § s ,w(G) denote the system of all orientations for 
which every w £ W is reachable from s. Transform G into a 
flow network G' by letting the capacities of all e £ E(G) be 
infinity, designating s as the source, and adding a destination 
t which is connected to every w £ W with edges of unit 
capacity. It is not hard to see that S s ,w(G) is transformed 
into S|ve|(G'). In this case, Theorem 1271 and Proposition 1311 
give the following results: 



Lemma 35. 

{X C E : The distance from s to t in Ge-x ts at most d} C 
sstr(§ d ) 

Proof. Let X C E be such that there exists ans-t path 
of length at most d in Ge-x and let p be such a path. Pick 
an orientation / of E — X such that in & B _ X , the path p is 



Theorem 38. For an arbitrary graph G: 

the number of orientations the number of subgraphs 

of G in which every = of G in which W U {s} is 
w G W is reachable from s connected. 

4 As a special case, pd = — 1 when there is no path of length 
at most din G. 



Proposition 39. Let t be the size of a minimum un- 
weighted Steiner tree for W U {s}. Then: 

dvc(S) = vc(^§) = m - t. 

A result equivalent to Theorem [38] was proven recently by 
Linusson [25]. Note that "S s ,w is SE" can be proven directly, 
without proving the more general flow-result first. As spe- 
cial cases, when W = {t}, the system § s ,w consists of all 
orientations with a path from s to t, and when W = V — {s}, 
the system S s ,w consists of all orientations in which s is a 
root. We obtain equalities between the number of orienta- 
tions that admit an s - t path and the number of subgraphs 
in which s and t are connected, respectively between the 
number of orientations in which s is a root and the number 
of connected subgraphs. 

We present another example: let G be a graph with edge 
lengths w : E(G) -> R-°, let A C V(G) and B C V(G). Let 
&A,B,d(G) denote the system of all orientations for which 
there exist u G A and v G B, such that the distance from 
u to v is at most d. The following transformation can be 
made: add source s and destination t to G, and connect 
every vertex in A to s, respectively every vertex in B to 
t, using edges of zero length. Denoting the obtained graph 
by G' , we can see that §A,s.d(G) is transformed into Sd(G'). 
The results are analogous to Theorem[33]and Proposition l37l 

4.4 Discussion 

Several characterizations of SE systems were given in the 
past twenty years [101 [6j 1211 I28| . In this subsection, we 
present a characterization which was found independently by 
Lawrence [53], and by Bollobas and Radcliffe [TD] and seems 
to be more natural in the context of graphs. To formalize 
this characterization, we need to introduce some concepts. 

Let X be a set. Given Y C X, a Y-cube of {0, 1} X is 
an equivalence class of the following equivalence relation on 

{0,1} X : 



"it agrees with v on X — Y" 



A cube of 



{0, 1} is a Y-cube for some Y C X. Given C, a y-cube 
of {0, 1} X , we define dim(C) = Y. Note that the number 
of F-cubes is 2' x ~ y ', they are mutually disjoint and they 
cover {0, 1} X . 

Let § = (S, {0, 1} X ) be a system and C C G(§) be a cube. 
It is useful to consider the structure (S(E) PI C, C) as a sys- 
tem. However, formally it is not a system. To deal with 
this technicality we give the following definition: The re- 
striction of § to C is the system {Cj, {0, l} dim(c) ^ where 

Q — { /Idim(C) ■ / £ SnC}. A system is a restriction of § 
if it is a restriction of § to some cube C C C(S). 

The antipodal system of § is ap(§) = (S, {0, 1} X ), where 
S = {/ : 1- / £ S}. A system S is symmetric, if § = ap(S). 
Recall that a system § is trivial if S(S) G {0, G(§)}. 



Theorem 40 (Lopsidedness [MIES])- A systems is 
SE, iff it has no non-trivial, symmetric restrictions. □ 



For example, consider §> cy c, the system of all cyclic orien- 
tations of G, and let Y C E(G). A y-cube C of 0(G) 
corresponds to a partial orientation of G in which only the 
edges of E(G) — Y are oriented. The restriction of S to C 
corresponds to all extensions of the partial orientation to an 
orientation of G which contains a cycle. In this case, the 
system S cyc is symmetric, since flipping all the edges of a 
directed cycle yields a directed cycle. Also, S CJ/C is trivial if 
and only if G is a forest. 

Let us define the Hip-distance between two orientations / 
and g of a graph G as the number of edges in E(G) on which 
/ and g differ. Let P be a property of orientations, such that 
the corresponding system, Bp, is SE. From a known prop- 
erty of SE systems [101 [B], it follows that the orientations 
in Sp form an isometric subgraph of the hypercube {0, 1} E , 
with edges connecting pairs of orientations of flip-distance 
one (partial cube property). As a consequence, if / and g are 
orientations of G satisfying P, then there exists a sequence 
of edge-flips from / to g, with all intermediate orientations 
of the sequence satisfying property P and with the length of 
the sequence equal to the flip-distance between / and g. 

5. CONCLUSION AND FURTHER WORK 

In this paper we studied a variety of natural properties of 
graph orientations. In particular, we have shown that for 
many of these properties, concepts related to VC-theory, 
such as VC-dimension and shattering have natural interpre- 
tations. 

One natural question is whether the graph-theoretical re- 
sults presented in this paper can be proven more directly. 
In particular: do there exist natural injective and surjective 
maps that imply the different inequalities? 

Another possible application of the connection presented in 
this paper is to a particular type of supervised learning prob- 
lem, that could be called "orientation learning". In this type 
of problem, a graph G and a property P of orientations are 
given. A single target orientation d satisfying P is selected 
to be learned. In machine learning terms, P is the hypoth- 
esis space, and d is the target hypothesis. The problem can 
be formulated both in the classical passive learning or in the 
active learning [34] framework. 

Different variants of these problems have been studied, mostly 
for complete and random graphs, where P is the property of 
acyclic orientations [3l 1221 [2], We believe that the connec- 
tions presented in this paper may be useful for understand- 
ing the learnability of other properties P in other classes of 
graphs as well. 
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Note that the systems discussed in S I 3 - II and § 13.21 are sym- 
metric and thus they are SE if and only if they are trivial. 
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